Circuit Judge, dissenting:

I agree with much of what the majority has written. In particular, the majority is correct in noting that the appellants’ allegations focus principally on wrongdoing by local defendants. I do not, however, agree that the federal defendánts can be properly dismissed in the present Rule 12(b)(6) posture of the case. I respectfully submit that *1538the majority has erroneously drawn inferences in favor of the federal defendants (ie.g., that the appellant’s failure to include the local housing authority as a defendant constitutes an admission that the authority is free from discrimination; see also footnote 5 of the majority opinion for inferences drawn in favor of the federal defendants). While further development of the record may justify these inferences, I cannot conclude that it is “beyond doubt that the plaintiff can prove no set of facts in support of his claim which would entitle him to relief.” Conley v. Gibson, 355 U.S. 41, 45-46, 78 S.Ct. 99, 101-102, 2 L.Ed.2d 80 (1957). Accordingly, I dissent.

These two class actions were filed by separate groups of plaintiffs alleging that officials of the Fulton County Commission, the Department of Housing and Urban Development (HUD), and the mayor and council of the City of Alpharetta, Georgia have engaged in discriminatory practices that have frustrated the development of low-income public housing in Alpharetta and the unincorporated areas of north Fulton County. The federal defendants moved to dismiss the claims against them on the ground that the plaintiffs’ complaints failed to state a claim upon which relief could be granted. The district court granted their motion, and we affirm its decision.1

Although the plaintiffs originally asserted claims against the federal defendants based on a variety of statutes, for the purposes of this appeal we can confine our attention to the question of whether their complaint states a cause of action against the federal government under the Fair Housing Act of 1968 (Title VIII), 42 U.S.C. § 3601 et seq. The plaintiffs place their principal reliance on 42 U.S.C. § 3608(d),2 which provides in relevant part:

*1532(d) The Secretary of Housing and Urban Development shall—

(3) cooperate with and render technical assistance to Federal, State, local, and other public or private agencies, organizations, and institutions which are formulating or carrying on programs to prevent or eliminate discriminatory housing practices;

(5) administer the programs and activities relating to housing and urban development in a manner affirmatively to further the policies of this sub-chapter.

The plaintiffs contend that the federal defendants failed to carry out their responsibilities under these sections, arguing that although they knew or should have known that public officials in north Fulton County had a history of excluding public housing on racial grounds, HUD took no action to counter the deliberate foot-dragging of local governments. Because of these alleged past sins of omission, the plaintiffs seek declaratory and injunctive relief requiring HUD to “take all necessary, appropriate and effective actions, including the provision of the first available funds and technical assistance, to insure the development of public housing” in the areas in question.

In order to appreciate the nature of the claim advanced by the plaintiffs here, it is necessary to quickly sketch the factual background of this case.3 The present controversy originated in 1971, when a federal district court found that Fulton County officials had deliberately obstructed attempts to place low-income public housing in unincorporated areas of the county for racially motivated reasons. Crow v. Brown, 332 F.Supp. 382 (N.D.Ga. 1971). The Housing Authority of Fulton County was created the following year, and the Authority and the County Commission soon concluded a cooperation agreement whereby the Commission agreed to adjust zoning where necessary and to provide water and sewer services to as many as one thousand public housing units on a nondiscriminatory basis. The Housing Authority apparently took no action to effectuate this agreement until 1978, when it submitted an application to HUD for federal financial assistance to construct two hundred units of low-income family housing on four sites in north Fulton County. HUD set aside certain funds for use in developing the project, then awaited the required “commitment letter” from the County Commission indicating that it was willing to supply the necessary water and sewer services for the proposed sites of the units. See 42 U.S.C. § 1439(c).

Although the Housing Authority first requested the commitment letter from the Commission in January 1979, the letter was not finally provided until March 1980. By this time, unfortunately, two of the four sites proposed in the original application were no longer available. In April 1980, HUD granted its preliminary approval to the Housing Authority’s request for federal assistance with regard to the two remaining sites, and authorized the Authority to proceed with site appraisal and acquisition. According to the plaintiffs, however, the long delay in the County Commission had permitted opposition to the plan to jell in the community, and the City of Alpharet-ta moved to frustrate the Housing Authority’s plans by annexing a third proposed site at Hopewell Road and rezoning it for commercial development on highly favorable terms. The final remaining site also became unavailable for reasons that do not appear in the complaint. Thus frustrated, the Housing Authority decided to amend its initial request to provide for only one hun*1533dred units of low-income family housing and another one hundred units of low-income housing for the elderly. Efforts to locate suitable sites continued during the rest of 1980, and at one point the Housing Authority managed to secure a commitment letter from the Commission for a site that was proposed for family housing. “[F]or reasons which are unclear to Plaintiffs,” HUD refused to approve the site. The Housing Authority then managed to locate two further sites, proposing that one be developed for family and the other for elderly housing. Eventually, the Authority was successful in obtaining a commitment letter for the latter, but not for the former. HUD then informed the Authority that the funds allocated in the original reservation were only sufficient to permit the development of one site. Shortly thereafter HUD redesignated the Authority’s fund reservation solely for elderly housing. One hundred units of housing for the elderly have been completed since the initiation of this litigation, but the unincorporated areas of north Fulton County otherwise remain as destitute of low-income multi-family public housing as they were when Judge Eden-field issued his order in Crow v. Brown almost thirteen years ago.

As we have seen, plaintiffs essentially allege that the federal defendants did not do what they ostensibly ought to have done under sections 3608(d)(3) and (5). Specifically, the plaintiffs contend that HUD should have pressured the County Commission into supplying the commitment letter for the Hopewell Road site in a reasonable time, or alternatively should have either waived its commitment letter requirement or authorized the Housing Authority to take legal action to obtain the commitment letter. The plaintiffs also suggest that HUD should have allowed the Housing Authority to exercise condemnation powers to secure the necessary sites, and they denounce HUD for agreeing to the Housing Authority’s subsequent amendment changing the nature of the proposal to a mix of family units and housing for the elderly.4 The Housing Authority itself is not named as a defendant in this case, so it appears that this is not an instance where the plaintiffs accuse HUD of closing its eyes to the discriminatory practices of a grantee. Instead, the plaintiffs contend that HUD violated its obligation under section 3608(d)(5) to “administer the programs and activities relating to housing and urban development in a manner affirmatively to further the policies” of the Fair Housing Act because it failed to do what the grantee was unable to do for itself. They further assert that there is an implied private cause of action under the statute which permits them to bring suit to specifically enforce the “assistance” provision of section 3608(d)(3). These are both novel contentions, and we do not find the plaintiffs’ arguments persuasive.

*1534It is of course true that section 3608(d)(5) has been recognized as imposing an affirmative duty upon the Secretary of HUD to work toward the goal of desegregation in housing. See, e.g., Resident Advisory Board v. Rizzo, 564 F.2d 126, 139-40 (3d Cir. 1977), cert. denied, 435 U.S. 908, 98 S.Ct. 1457, 55 L.Ed.2d 499 (1978); Acevedo v. Nassau County, 500 F.2d 1078, 1082 (2d Cir. 1974); Otero v. New York City Housing Authority, 484 F.2d 1122, 1133-34 (2d Cir. 1973); Shannon v. HUD, 436 F.2d 809, 816 (3d Cir. 1970). Most actions in which private plaintiffs have brought suit against HUD pursuant to section 3608(d)(5) have involved challenges to funding decisions made by HUD officials, usually on the grounds that the grantee has either engaged in discriminatory practices or proposes to locate a new low-income housing project in an area where there is already a heavy concentration of economically disadvantaged or minority citizens. See, e.g., Clients’ Council v. Pierce, 711 F.2d 1406, 1422-25 (8th Cir. 1983); Alschuler v. HUD, 686 F.2d 472, 475 (7th Cir. 1982); Business Association v. Landrieu, 660 F.2d 867, 870-71 (3d Cir. 1981); Shannon v. HUD, 436 F.2d at 811-12; King v. Harris, 464 F.Supp. 827, 837 (E.D.N.Y.), aff'd without opinion sub nom. King v. Faymor Development Corp., 614 F.2d 1288 (2d Cir. 1979), vacated on other grounds, 446 U.S. 905, 100 S.Ct. 1828, 64 L.Ed.2d 256 (1980). In these cases, the courts have considered whether HUD’s decision could be sustained under the “abuse of discretion” standard set forth in 5 U.S.C. § 706(2)(A) in view of the stated objectives of the Fair Housing Act. The plaintiffs in this case, in contrast, cannot point to any decision by HUD which might lend itself to judicial review.5 They allege not that HUD has acted wrongly, but that it has not acted at all, and that this constitutes a breach of its obligations under sections 3608(d)(3) and (5). In their view, HUD is guilty of a violation of these sections of the Fair Housing Act whenever it simply “maintains a ‘low profile’ in the face of known racial opposition to the construction of public housing.”

This is a potentially sweeping re-interpretation of the nature of the affirmative duty imposed upon HUD by the Fair Housing Act, and we conclude that it has no support either in the terms of the statute, the statu*1535tory history, or the applicable case law. The remarks of the principal sponsors of the Fair Housing Act during the Senate debate suggest that they thought the provisions at issue were necessary because federal housing administrators had traditionally given little consideration to the impact of their decisions on the racial or socio-eco-nomic composition of a given neighborhood. As Senator Edward Brooke stated:

Today’s Federal housing official commonly inveighs against the evils of ghetto life even as he pushes buttons that ratify their triumph — even as he ok’s public housing sites in the heart of Negro slums, releases planning and urban renewal funds to cities dead-set against integration, and approves the financing of suburban subdivisions from which Negroes will be barred. ...

In other words, our Government, unfortunately, has been sanctioning discrimination in housing throughout this Nation.

114 Cong.Record 2281 (1968). Later in the debate, Senator Brooke reiterated this point: “Rarely does HUD withhold funds or defer action in the name of desegregation ... It is clear that HUD is determined to speak loudly and carry a small stick.” Id. at 2527-28. The bill’s sponsors sought to remedy this bureaucratic myopia by requiring federal housing administrators to take account of the effect of their funding decisions upon the racial and socioeconomic composition of affected areas. Otero, 484 F.2d at 1133-34.

There is a vast difference, however, between requiring HUD’s officials to include a particular consideration in their decision-making calculus, and suggesting that a federal agency has an affirmative legal duty to correct injustice wherever it exists. The latter interpretation of HUD’s mission under section 3608(d) goes far beyond the concerns that Senator Brooke expressed about misguided bureaucratic decision-making, and it is unsupported by the language of the statute itself. Section 3608(d)(3) simply requires HUD to supply “technical” assistance to other agencies or organizations that are concerned with the problem of fair housing, while section 3608(d)(5) appears to pertain only to the “programs and activities” which HUD itself is directly responsible for administering. In addition, the statute provides HUD with few weapons to employ against wrongdoers. The Secretary is clearly empowered to “withhold funds or defer action in the name of desegregation,” 114 Cong.Record 2527-28 (1968), and Title VIII admittedly places fewer administrative and statutory constraints upon his ability to revoke funding than apply under Title VI of the Civil Rights Act of 1964, 42 U.S.C. § 2000d-l. See Young v. Pierce, 544 F.Supp. 1010, 1017 (E.D.Tex. 1982). Beyond that, however, the Secretary’s powers are quite limited. As the Supreme Court emphasized in Trafficante v. Metropolitan Life Insurance Co., 409 U.S. 205, 93 S.Ct. 364, 34 L.Ed.2d 415 (1972):

It is apparent ... that complaints by private persons are the primary method of obtaining compliance with the [Fair Housing] Act____

The design of the Act confirms this construction. HUD has no power of enforcement. So far as federal agencies are concerned only the Attorney General may sue; yet, as noted, he may sue only to correct “a pattern or practice” of housing discrimination. That phrase “a pattern or practice” creates some limiting factors in his authority which we need not stop to analyze. For ... most of the fair housing litigation conducted by the Attorney General is handled by the Housing Section of the Civil Rights Division, which has less than two dozen lawyers. Since HUD has no enforcement powers and since the enormity of the task of assuring fair housing makes the role of the Attorney General in the matter minimal, the main generating force must be private suits____

Id. at 209-11, 93 S.Ct. at 366-367. Thus, there is little that HUD can do beyond exerting moral suasion to “pressure” local officials into compliance with the goals of the Fair Housing Act when it is not currently funding a local agency. The plain*1536tiffs suggest that this would leave citizens without redress where local officials have engaged in discriminatory practices and HUD is not involved, but this contention is clearly incorrect. As Trafficante suggests, they are encouraged to bring suit as private attorneys general, and the effectiveness of the statutory scheme is in fact dependent on their willingness to do so. Where HUD is not supporting discrimination through its funding practices, there is little to be gained by naming it as a defendant. See, e.g., Otero v. New York City Housing Authority, 354 F.Supp. 941, 957 & n. 18 (S.D.N.Y.) (dismissing claims against HUD where full relief sought by plaintiffs could be obtained by decree against local housing authority and no claim was made of affirmative discriminatory action by HUD), rev’d on other grounds, 484 F.2d 1122 (2d Cir. 1973). We conclude that the drafters of the Fair Housing Act did not intend for HUD to be subjected to liability under circumstances such as these.

Further support for this construction of the intent of section 3608(d) can be found in the applicable case law. The plaintiffs contend that there are essentially two different lines of eases interpreting HUD’s duties under section 3608(d). The first of these involves challenges to “the routine approval process for public housing applications” and is governed by the “abuse of discretion” standard, while a second group comprises situations where “it is alleged that HUD failed to act, or even compounded the effects of racial opposition by its own actions, knowing or forewarned of racial barriers to fair housing.” The plaintiffs suggest that this second group of cases is subject to judicial scrutiny under a heightened “abuse of discretion” standard, and that liability can be found on HUD’s part if it fails to use its “best efforts” to see that low-income housing is constructed or simply maintains a “low profile” in the face of known racial opposition to fair housing.

Unfortunately, this interpretation of the ease law does not stand up upon closer examination. The first difficulty with the argument advanced by the plaintiffs is that it would be anomalous to subject HUD to a tougher standard of judicial scrutiny in cases in which its involvement is marginal or non-existent than applies when HUD is accused of supporting discrimination through its financial assistance to local governmental entities. In addition, a careful reading of the cases cited in the plaintiffs’ brief provides little support for their analysis. All of the cited eases involved situations where HUD either was accused of taking discriminatory action itself or was actively involved in financing local public housing authorities who had poor records on fair housing. These decisions are therefore not analogous to the present case. For example, the plaintiffs rely heavily on Judge Justice’s statement in Young v. Pierce that “violations of [HUD’s affirmative duty] through inaction or indolence must be actionable.” 544 F.Supp. at 1018. Elsewhere, however, Judge Justice makes it plain that Young is simply another case where HUD was accused of closing its eyes to the discriminatory practices of one of its grantees.6 In Jaimes v. Toledo Metropolitan Housing Authority, 432 F.Supp. 25 (N.D. Ohio 1977), HUD was charged with continuing its support for the TMHA despite that agency's failure to *1537make serious efforts to locate low-income housing in suburban areas. There, however, the plaintiffs further alleged that “HUD [had] instructed TMHA not to seek cooperation agreements from other local governing bodies outside the City of Toledo.” Id. at 27 (emphasis added). The plaintiffs also cite Resident Advisory Board v. Rizzo, where the complaint alleged that HUD had refused to consider terminating its support of other city programs despite the city’s staunch opposition to a proposed low-income housing development. 564 F.2d at 137. Finally, in King v. Harris, the plaintiffs were contesting HUD’s decision to provide financial support for a low-income housing project in an integrated neighborhood with a delicate racial balance. 464 F.Supp. at 830. Thus, none of these cases support the plaintiff’s argument that HUD can be found liable for a violation of section 3608(d)(5) where it is not currently involved in providing federal financial assistance to local housing authorities.

A more plausible interpretation of the case law indicates that HUD is subject to liability under section 3608(d)(5) only where it has disbursed federal funds to local housing authorities who are engaged in activities that will “establish and add to segregation in housing patterns.” Garrett v. City of Hamtramck, 503 F.2d 1236, 1247 (6th Cir. 1974). This approach — which does not impose liability on HUD where it is not yet directly involved — is both logical and fair. It recognizes that, since the termination of federal funds is virtually the only weapon available to HUD in its efforts to enforce the Fair Housing Act, there is little to be gained by holding HUD accountable in situations where it lacks even this leverage. This principle was recognized by the Sixth Circuit in Garrett, where it found that HUD could be held jointly liable with the city with regard to one housing project which HUD had approved even after it became aware of the city’s discriminatory practices. The court refused to hold HUD liable with regard to two other pending projects, however, because “[s]ince neither [project] has been approved by HUD, or, in fact, submitted to it for approval, HUD cannot be held responsible for any wrongs suffered by the residents of these areas at the hands of the City.” 503 F.2d at 1247-48. Similarly, the Second Circuit stressed in Acevedo v. Nassau County, 500 F.2d 1078, 1082 (2d Cir. 1974), that although section 3608(d)(5) imposes a duty on HUD to administer its programs and activities in such a way as to further the goal of integration, “[t]he Fair Housing Act does not impose any duty upon a governmental body to construct or to ‘plan for, approve and promote’ any housing.” Id. at 1082.

Under our interpretation of the statute and case law, therefore, HUD’s affirmative obligation under section 3608(d)(5) may subject it to liability in two types of situations: first,' when HUD has taken discriminatory action itself, such as approving federal assistance for a public housing project without considering its effect on the racial and socio-economic composition of the surrounding area, see, e.g., Shannon v. HUD, 436 F.2d at 811-12; and second, when HUD is aware of a grantee’s discriminatory practices and has made no effort to force it into compliance with the Fair Housing Act by cutting off existing federal financial assistance to the agency in question. See, e.g., Client’s Council v. Pierce, 711 F.2d at 1422-23; Gautreaux v. Romney, 448 F.2d 731, 739 (7th Cir. 1971). Since the plaintiffs’ complaint in this case fall into neither of these categories, we conclude that they have not stated a claim upon which relief can be granted.7 The decision of the district court is therefore

AFFIRMED.